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SYSTEM AND METHOD FOR INCORPORATING SEMANTIC 
CHARACTERISTICS INTO THE FORMAT-DRIVEN SYNTACTIC DOCUMENT 

TRANSCODING FRAMEWORK 

5 

BACKGROUND OF THE INVENTION 

1. Technical Field: 

10 The present invention relates to the field 

information processing in a distributed network. More 
particularly, the present invention relates to the 
transcoding of web based content and enterprise content 
from one format to another. Still more particularly, the 

15 present invention relates to a system and method for 
increasing the functionality of transcoders by the 
inclusion of semantic features. 

2. Description of Related Art: 

20 Transcoding is the process of transforming the 

format and representation of content. Computers, of 
course, are not inherently intelligent; they need to be 
told exactly what things are, how they are related, and 
how to deal with them. Clearly, a simple way for 

25 computers to communicate and readily exchange data is 
needed. Transcoding is a key element in this exchange. 
What all of this means is, enterprise data and 
applications, or web-based data, can be leveraged by 
multiple users with multiple devices in a manner that is 

30 seamless across the network, and in a manner that is 

tailored to the specific user and device. The content, 
therefore, may be delivered in a wide range of networks. 

There is a vast repository of data available on the 
Web. There is an even larger repository of business 
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information, such as enterprise data, available on legacy 
systems. There is a substantial opportunity to extend 
the use of enterprise data by transcoding the formats, 
that is, bringing them out from behind legacy protocols. 
5 As enterprises expand into new e-business markets, and as 
their workforces become more mobile and widespread, easy 
access to legacy data becomes even more critical* 
There are three main types of transcoding: 
Data or syntactical transcoding is the conversion of 

10 data from one format to another, typically from a non 
web-friendly format to a friendly one (e.g.. Advanced 
Function Presentation (AFP) to Scalable Vector Graphics 
(SVG) , extensible markup language (XML) to hypertext 
markup language (HTML), etc.). Data transcoding can be 

15 used to take advantage of new web formats, such as SVG 
and extensible HTML (XHTML) . Other examples of 
syntactical transcoding include converting the format of 
portable document format (PDF) documents to HTML or XML. 
For example, many portal web sites provide a map service 

20 for users to locate specific addresses across the United 
States (e.g., Yahoo, a product of Yahoo!, Inc., 3420 
Central Expressway, Santa Clara, CA 95051) . Today, the 
original vector-based map data is converted to a graphics 
interchange format (GIF) file before being sent to the 

25 client browser. Once SVG becomes a standard format 
supported by browsers, a transcoder can be used to 
convert the map data into SVG on the fly, preserving the 
quality and flexibility of the original data. Users will 
then be able to manipulate that vector graphics data 

30 locally on the client without having to access the server 
again. Data transcoding can also be used to aggregate 
content for presentation to the user in a convenient and 
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accessible manner. Again, portals such as Yahoo are a 
good example. They allow their customers to configure 
their own home pages to provide a wide range of tailored 
information, from news and weather to favorite links and 
email status. The formats of the original data from this 
wide variety of sources must be converted to a 
browser-friendly format before being sent to the client. 
Reformatting of content is necessary in order to achieve 
universal access because devices utilize different markup 
languages to render content. For example, many wireless 
phones use the Wireless Markup Language (WML) to render 
content instead of HTML. Furthermore, the Palm Pilot 
uses Compressed Markup Language (CML) , its own variant of 
HTML. 

Device transcoding is the conversion of web 
formatted data (e.g., HTML) to one more suitable for 
displaying on certain devices, typically the filtering of 
data to be displayed on less capable clients in the 
Pervasive Computing (PvC) space. There are many reasons 
why content must be filtered, transformed, or reformatted 
to enable it to be universally accessed by devices. 
Filtering is typically required whenever resource 
constraints prohibit the storing or timely transmission 
of content. Because devices differ in the amount of 
memory that is accessible, they vary greatly with regard 
to how much content they are capable of storing. As a 
result, it may be necessary to filter out some content, 
such as large GIF and JPEG (joint photographic experts 
group) images, for devices with limited memory. 
Similarly, for devices connected by narrow bandwidth 
channels (e.g., 8 kbps) , it may not be possible to 
deliver content that contains a large number of images in 
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a timely fashion. Transformation is typically required 
to achieve universal access because many devices are only 
able to render a limited number of content 
representations. For example, the PalmPilot, available 
5 from 3COM Corporation, 5400 Bayfront Plaza Santa Clara, 
CA 95052-8145, is only capable of rendering images of 
Palm bitmap. Therefore, content that exists in GIF or 
JPEG must be transformed to Palm bitmap to be rendered. 
Other examples of transformation include the scaling of 

10 an image to enable it to completely fit on a display, and 
the rendering of text as synthesized speech for 
voice-driven car browsers. 

Protocol transcoding is the transcoding of data 
which is typically broadcast using a non-HTTP protocol 

15 (e.g., 3270 (a class of terminals known as Display 

Devices, normally used to talk to IBM mainframes) , 5150, 
etc) into Hypertext transfer protocol (HTTP) format, to 
be displayed using a normal browser. Examples include 
the implementation of a 3270 terminal, a customer 

20 information control system (CICS, an IBM communications 
system now used for database handling) client, etc, 
(3270, 5150 and CICS are all registered trademarks of the 
IBM Corporation) . This requires transcoding in both 
directions, as the user input needs to be converted back 

25 into the original protocol. Where bandwidth is an issue, 
for example, in a slow wireless connection, it may be 
necessary to transmit the web content in a protocol with 
suitable compression. The content would have to be 
transcoded twice, once at each end of the wireless 

30 connection. 
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Figure 1 depicts a prior art relationship between 
transcoding proxy 100, client 120 and web server 110, 
Initially, client 120, including an Internet browser, 
makes a request for a uniform resource locator (URL) . 
5 Transcoding proxy 100 passes the request to web server 
120 and intercepts the returned request results intended 
for client 120. Transcoding proxy 100 converts the 
requested documents to a form compatible with client 120 
prior to returning the requested documents to client 120. 

10 In the depicted figure, transcoding proxy 100 includes 
syntactical transcoder 102, which further includes a 
plurality of transcoder functions Al to AN, for 
converting individual data formats from one format to 
another. Also included in transcoding proxy 100 is 

15 device transcoder 104, which further includes a plurality 
of transcoder functions CI to CN, for converting web 
formatted data to a format more suitable for displaying 
on certain devices. Finally, included in transcoding 
proxy 100 is protocol transcoder 106, which further 

20 includes a plurality of transcoder functions Bl to BN, 

for converting data which is typically broadcast using a 
non-HTTP protocol into HTTP format, to be displayed using 
a normal browser. Syntactical transcoder 102, device 
transcoder 104, and protocol transcoder 106 select the 

25 proper transcoder function by comparing syntactical, 

device, and protocol preferences supplied by client 120 
with the returned requested document from web server 110. 

Transcoding proxy 100 reformats the requested document 
according to the preference data supplied by client 120 

30 and transfers the document to client 120. 
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It is often the case that a single transformation 
for the data is not enough. For example, a portal 
transcoding application which has to supply a customized 
home page to a user who owns several web accessing 
5 devices, including a desktop computer and a palm 

computer, would first use data transcoding to convert the 
original source data into a presentation neutral format. 
Then, based on the type of device the user requested the 
information from, a second transformation, this time 

10 device transcoding, would be made to tailor the web 

content to be compatible with the target device. XML is 
an important technology for this type of transcoding. 
XML grammars are presentation neutral, which makes them 
excellent candidates for intermediate formats between 

15 legacy data and the final presentation form. 

Figure 2 depicts a prior art configuration between 
transcoding proxies 200, 210 and 220, client 240, and web 
server 250, for providing multiple transformations in 
order to properly format a document for a client. 

20 Transcoding proxies 200, 210 and 220 are identical in 
functionality to transcoding proxy 100 and, therefore, 
will not be discussed in detail again. In the depicted 
example, client 240 makes a request for a uniform 
resource locator (URL) . Transcoding proxy 200 passes the 

25 request to web server 250 and intercepts the results for 
client 240. Transcoding proxy 200 attempts to convert 
the requested document to a form compatible with client 
240. 

However, in the depicted example, as syntactical 
30 transcoder 202, device transcoder 206, and protocol 

transcoder 204 attempt to select the proper transcoder 
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function, it is determined that transcoding proxy 200 
does not possess the proper transcoder function to effect 
a complete transformation. In comparing the client 
preferences to the format of the returned requested 
5 document, a necessary transcoder function is missing. 

Therefore, rather than returning an improperly formatted 
document to client 240, transcoding proxy 200 passes the 
document to one of transcoding proxies 210 and 220 for 
intermediate processing. In so doing, transcoding proxy 
10 200 can return a properly formatted document to client 
240. 

Transcoding occurs after the source data has been 
accessed (from a database, file server, etc.) but before 
the end user is able to access it. Precisely where the 

15 transcoding takes place depends upon the specific 

transcoding application. For example, the transcoding of 
financial data is likely to take place on or near the 
origin server for security reasons (i.e., inside the 
financial company's firewall). Device transcoding is 

20 more likely to take place as a last step before delivery 
to the user's web browser. In some cases, it may even be 
desirable to transcode data on the target client machine. 

The term 'reverse proxying' refers to a setup where 
the proxy server is run in such a way that it appears to 

25 clients like a normal web server. That is, clients 

connect to it considering it to be the destination origin 
server and do not know that requests may be relayed 
further to another server, even through other proxy 
servers . 

30 The word 'reverse' in reverse proxy refers to the 

inverted role of the proxy server. In the regular (i.e*. 
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forward) proxy scenario, the proxy server acts as a proxy 
for the client. The request is made on behalf of the 
client by the proxy server. However, in the reverse 
proxy scenario, the reverse proxy server acts as a proxy 
5 for the server. The proxy services requests on behalf of 
the server. While this may seem to be the same concept, 
merely expressed in two ways, the distinction becomes 
clear when considering the relationship of the proxy 
server to its client and origin server. 

10 A forward proxy server, or a set of them, acts as a 

proxy to one or more clients. From the client's 
perspective, the proxy server is dedicated to servicing 
that client's needs, and all requests may be forwarded to 
the proxy server. A given client will use the same proxy 

15 server over a period of time, and the proxy configuration 
is dependent on the site where the client is running. 
Forward proxy servers are usually run by the client 
organization or an internet service provider. Forward 
proxy servers are fairly close to the client . Conversely, 

20 a reverse proxy server represents one or a few origin 
servers. Typically, random servers cannot be accessed 
through a reverse proxy server. Only a predetermined set 
of files — those available from the origin server (s) that 
the reverse proxy is serving—are available from the 

25 reverse proxy server. A reverse proxy server is a 
designated proxy server for those specific servers. 
Furthermore, the designated proxy server is used by all 
clients for access to the specific site of the server 
being serviced. A reverse proxy server is usually run by 

30 the same organization that runs the main origin server 
for which the proxy is a reverse proxy. 
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The reverse proxy concept is useful in terms of 
transcoders because a transcoding proxy server most often 
works as a reverse proxy server. Therefore, transcoding 
servers dedicated to the dissemination of enterprise 
5 information over a network would take responsibility for 
converting the requested documents into a format 
compatible with the network. 

Prior art transcoding servers can also transcode 
data from many origin servers, both within and outside 

10 the enterprise. Prior art transcoding proxies have 
heretofore not integrated semantic information with 
syntactic format transcoding. While separate methods for 
natural language translation and syntactic transcoding 
exist, the broad area of semantic transcoding, 

15 particularly with the semantic information, has been 
overlooked by prior art. 
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SUMMARY OF THE INVENTION 

Initially, a client requests a specific document and 
5 provides the preferences, including readability level 
preferences of the document, locale preferences, content 
filtering instruction preferences, governmental 
regulation preferences, natural language preferences, and 
document syntactic format preferences. The transcoding 

10 proxy requests and receives the document from the origin 
server, with the document having origin semantic 
characteristics. The document from the origin server has 
an origin readability level and origin locale; it is 
conformant with origin content filtering instructions and 

15 origin governmental regulations; and it is in origin 
natural language and origin document syntactic format. 

Using the client semantics preferences, the 
transcoding proxy revises the document in a sequential or 
parallel fashion. The origin semantic characteristics of 

20 the document are thus revised to the semantic preferences 
specified by the client. 
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BRIEF DESCRIPTION OF THE DRAWINGS 

The novel features believed characteristic of the 
5 invention are set forth in the appended claims. The 

invention itself, however, as well as a preferred mode of 
use, further objectives and advantages thereof, will best 
be understood by reference to the following detailed 
description of an illustrative embodiment when read in 
10 conjunction with the accompanying drawings, wherein: 

Figure 1 depicts a prior art relationship between a 
transcoding proxy, a client, and a web servers- 
Figure 2 depicts a prior art configuration between 
three transcoding proxies, a client, and a web server, 
15 for providing multiple transformations in order to 
properly format a document for a clients- 
Figure 3 is a pictorial representation of a 
distributed data processing system in which the present 
invention may be implemented; 
20 Figure 4 is a block diagram of a data processing 

system which may be implemented as a server in accordance 
with the present invention; 

Figure 5 is a block diagram of a data processing 
system which may be implemented as a client, in which the 
25 present invention may be implemented; 

Figure 6 is a block diagram illustrating a preferred 
embodiment of the present invention, for implementing 
semantics features in a syntactical transcoder; 

Figure 7 is a flowchart depicting the process of 
30 converting document semantics in association with 
converting the document's syntactic format; and 
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Figure 8 depicts a configuration between a plurality 
of transcoding proxies, a client, and a web server, for 
providing multiple transformations in order to provide a 
wide range of semantics preference options in formatting 
5 a document for a client. 
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DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT 

With reference now to the figures, and in particular 
5 with reference to Figure 3, a pictorial representation of 
a distributed data processing system in which the present 
invention may be implemented is depicted. 

Distributed data processing system 300 is a network 
of computers in which the present invention may be 

10 implemented. Distributed data processing system 300 
contains a network 302, which is the medium used to 
provide communications links between various devices and 
computers connected together within distributed data 
processing system 300. Network 302 may include permanent 

15 connections, such as wire or fiber optic cables, or 

temporary connections made through telephone connections. 

In the depicted example, server 304 is connected to 
network 302 along with storage unit 306, In addition, 
clients 308, 310 and 312 also are connected to network 

20 302. These clients 308, 310 and 312 may be, for example, 
personal computers or network computers. For purposes of 
this application, a network computer is any computer 
coupled to a network, which receives a program or other 
application from another computer coupled to the network. 

25 In the depicted example, server 304 provides data, such as 
boot files, operating system images, and applications, to 
clients 308-312. Clients 308, 310 and 312 are clients to 
server 304. Between any one of clients 308, 310 and 312 
and server 304 may exist a transcoding proxy of the type 

30 described above with respect to Figures 1 and 2, or 

alternatively, a reverse proxy which is not specifically 
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depicted in either illustration. Distributed data 
processing system 300 may include additional servers, 
clients, and other devices not shown. 

In the depicted example, distributed data processing 
5 system 300 is the Internet, with network 302 representing 
a worldwide collection of networks and gateways that use 
the TCP/IP suite of protocols to communicate with one 
another. At the heart of the Internet is a backbone of 
high-speed data communication lines between major nodes or 

10 host computers consisting of thousands of commercial, 
government, education, and other computer systems that 
route data and messages. Of course, distributed data 
processing system 300 also may be implemented as a number 
of different types of networks, such as an intranet or a 

15 local area network. 

Figure 3 is intended as an example and not as an 
architectural limitation for the processes of the present 
invention. 

Referring to Figure 4, a block diagram of a data 
20 processing system which may be implemented as a server, 
such as server 304 in Figure 3, is depicted in accordance 
with the present invention. Data processing system 400 
may be a symmetric multiprocessor (SMP) system including a 
plurality of processors 402 and 404 connected to system 
25 bus 406. Alternatively, a single processor system may be 
employed. Also connected to system bus 406 is memory 
controller/cache 408, which provides an interface to local 
memory 409. I/O bus bridge 410 is connected to system bus 
406 and provides an interface to I/O bus 412. Memory 
30 controller/cache 408 and I/O bus bridge 410 may be 
integrated as depicted. 
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Peripheral component interconnect (PCI) bus bridge 
414 connected to I/O bus 412 provides an interface to PCI 
local bus 416. Modem 418 and network adapter 420 may be 
connected to PCI bus 416. A network adapter is generally 
5 defined as any circuitry that allows devices to 

communicate with other devices on a particular network 
such as the Internet, an intranet or other network 
configuration including local area networks (LAN) and wide 
area networks (WAN) . Typical PCI bus implementations 
10 support four PCI expansion slots or add-in connectors. 
Communications links to network computers 308-312 in 
Figure 3 may be provided through modem 418 and network 
adapter 420 connected to PCI local bus 416 through add-in 
boards . 

15 Additional PCI bus bridges 422 and 424 provide 

interfaces for additional PCI buses 426 and 428, from 
which additional modems or network adapters may be 
supported. In this manner, server 400 allows connections 
to multiple network computers. A memory mapped graphics 

20 adapter 430 and hard disk 432 may also be connected to I/O 
bus 412 as depicted, either directly or indirectly. 

Those of ordinary skill in the art will appreciate 
that the hardware depicted in Figure 4 may vary. For 
example, other peripheral devices, such as optical disk 

25 drives and the like, also may be used, in addition to or 
in place of the hardware depicted. The depicted example 
is not meant to imply architectural limitations with 
respect to the present invention. 

The data processing system depicted in Figure 4 may 

30 be, for example, an IBM RS/6000 system, a product of 

International Business Machines Corporation in Armonk, New 
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York, running the Advanced Interactive Executive (AIX) 
operating system. 

With reference now to Figure 5, a block diagram of a 
data processing system in which the present invention may 
5 be implemented is illustrated. Data processing system 500 
is an example of a client computer. Data processing 
system 500 employs a peripheral component interconnect 
(PCI) local bus architecture. Although the depicted 
example employs a PCI bus, other bus architectures such as 

10 Micro Channel and ISA may be used. Processor 502 and main 
memory 504 are connected to PCI local bus 506 through PCI 
bridge 508. PCI bridge 508 also may include an integrated 
memory controller and cache memory for processor 502. 
Additional connections to PCI local bus 506 may be made 

15 through direct component interconnection or through add-in 
boards. In the depicted example, local area network 
adapter 510, SCSI host bus adapter 512, and expansion bus 
interface 514 are connected to PCI local bus 506 by direct 
component connection. In contrast, audio adapter 516, 

20 graphics adapter 518, and audio/video adapter (A/V) 519 
are connected to PCI local bus 506 by add-in boards 
inserted into expansion slots. Expansion bus interface 
514 provides a connection for a keyboard and mouse adapter 
520, modem 522, and additional memory 524. SCSI host bus 

25 adapter 512 provides a connection for hard disk drive 526, 
tape drive 528, and CD-ROM drive 530 in the depicted 
example. Typical PCI local bus implementations support 
three or four PCI expansion slots or add-in connectors. 

In the present example, an operating system runs on 

30 processor 502 and is used to coordinate and provide 



t 
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control of various components within data processing 
system 500 in Figure 5. The operating system may be a 
commercially available operating system, such as OS/2, 
which is available from International Business Machines 
5 Corporation. "OS/2" is a trademark of International 
Business Machines Corporation, or a UNIX based system, 
such as AIX, also available from International Business 
Machines Corporation. An object oriented programming 
system such as Java may run in conjunction with the 

10 operating system and provides calls to the operating 

system from Java™ programs or applications executing on 
data processing system 500. Instructions for the 
operating system, the object-oriented operating system, 
and applications or programs are located on storage 

15 devices, such as hard disk drive 526, and may be loaded 
into main memory 504 for execution by processor 502. 

Those of ordinary skill in the art will appreciate 
that the hardware in Figure 5 may vary, depending on the 
implementation. For example, other peripheral devices, 

20 such as optical disk drives and the like, may be used in 
addition to or in place of the hardware depicted in Figure 
5. The depicted example is not meant to imply 
architectural limitations with respect to the present 
invention. For example, the processes of the present 

25 invention may be applied to multiprocessor data processing 
systems . 

Figures 3-5 illustrate a preferred embodiment of a 
computer system that can advantageously employ the 
improved packet sequencing system of the present 
30 invention. The system of Figure 3 may be seen to 
represent clients or servers depicted in Figure 6. 
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Current web-based transcoders typically do one of 
the following: 

(1) Convert documents syntactically from one format 
to another, e,g., PDF to HTML, without 

5 analyzing the semantics; 

(2) Convert documents from web formatted data to a 
format more suitable for displaying on certain 
devices; and 

(3) Converts data which is typically broadcast 

10 using a non-HTTP protocol into HTTP format, to 

be displayed using a normal browser. 
There is an absence of support for converting documents 
based on semantic characteristics like readability level, 
locale, governmental regulations, and content-filtering 

15 in a web-based transcoding paradigm. 

However, with the Internet being widely used by a 
large section of the population with diverse reading 
skills, readability levels of documents transmitted 
across the Internet is of paramount importance. In 

20 addition, with the Internet being a global medium of 
communication, various incompatibilities involving 
locales, nature and form of content, governmental 
restrictions on documents, and natural language of 
content arise when documents are syntactically transcoded 

25 for transmission across national boundaries. 

Furthermore, many of these semantic features, like 
readability level, conversion, and language translation 
of documents, either after or before transcoding the 
syntactic format, are time-consuming, even in a server. 

^0 particular, a thin client may not have adequate 

resources for local installation of readability level 
conversion software or complex natural language 
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translation software • This invention seeks to facilitate 
the solution to the above problems by performing these 
semantic transcodings in the transcoding proxy in 
conjunction with syntactic transcoding. 
5 It should be stressed that there may be more 

semantic attributes associated with documents than the 
ones listed above. This invention provides a generalized 
method to incorporate these attributes into the syntax 
based transcoding framework. 

10 In accordance with a preferred embodiment of the 

present invention, a document transcoder in the 
transcoding proxy would have access to client semantic 
preference information over and beyond the syntactic 
document translation format. Such information on client 

15 preferences would include formatted data on the 

readability levels of documents. In many cases, the same 
document may be presented to readers with various levels 
of language skills. For example, a fifth-grade student 
has a different level of language skill than an English 

20 Ph.D. However, they may both need to read an article on 
the same topic on the Internet. A document on the 
selected topic could be presented at various readability 
levels, either by dynamic conversions to various 
readability levels or via multiple static versions, each 

25 with an associated readability level. 

Another client preference would include formatted 
data on the different locales, for instance numerics, 
currency, current time, date, etc., that vary from locale 
to locale. Natural language preferences would include 

30 formatted data on the language to which the document is 
to be translated, e.g., Spanish or Chinese. Still 
another client preference would include formatted data on 
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content filtering, to the extent possible, via existing 
filtering methodologies (e.g., material restricted to 
specific age groups and labeled as such, or parts of 
documents labeled as restricted to specific age groups) . 
5 Finally, another client preference would include 

formatted data on governmental regulations on encrypted 
data transmission, receipt in censorship, and security 
conscious entities (e.g., security classifications of 
documents) . National, as well as local regulations 

10 pertaining to the format and content of information may 
vary from one jurisdiction to another. Certain 
jurisdictions may restrict information from its 
residents. However, a resident of one jurisdiction may 
inadvertently request documents or technologies which are 

15 prohibited in the resident's own jurisdiction. 

Conversely, a jurisdiction might prohibit the exportation 
of certain information or technology to specific 
jurisdictions. In this case, a web server might 
inadvertently transfer restricted information to 

20 residents of the sanctioned jurisdiction. 

It is important to note that, prior to converting 
the semantic characteristics document (or even the 
syntactic characteristics), the present semantic 
characteristics of the document must be determined. 

25 Generally, the document attributes are contained in the 
document header describing the syntactic characteristics 
of the document, such as the document's format. However, 
the semantic characteristics of a document are much more 
inconspicuous. One method for determining and describing 

30 each semantic characteristic of a document is to identify 
individual semantic characteristics associated with the 
document in the document header, similar to syntactic 
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characteristics. For example, the readability level 
might be described as an eighth grade standard with the 
locale as the State of Virginia in the United States 
(from which locale, semantic characteristics such as 
5 monetary currency, time zone, and units of measure could 
be easily deduced) . The document's author may provide 
this information. Alternatively, an origin server may 
employ a semantic-crawler to analyze the semantic 
characteristics of each document on the server and then 

10 modify the document header to include descriptions of 
each relevant semantic characteristic based on the 
analysis. The semantic-crawler might also tag each word 
dealing with certain semantic characteristics, such as 
time, date, monetary units, or units of measure. In so 

15 doing, the transcoding proxy need only search for the 
tagged terms and words, and convert the terms according 
to the user preferences. 

While identifying the semantic characteristics of a 
document might be helpful, the document would still 

20 require parsing at the transcoding proxy for such 
semantic characteristics as readability and natural 
language. Moreover, while some documents may be received 
from the origin server with the semantic terms tagged, 
the proxy server could not rely on the origin server for 

25 tagging the semantic characteristics of a document. 

Therefore, in accordance with a preferred embodiment of 
the present invention, the transcoding proxy may include 
a semantic parser for parsing the words and terms in a 
document and analyzing the semantic characteristics of 

30 each word or phrase. Once the semantic terms have been 
identified, and the semantic characteristics have been 
defined, the transcoding proxy can convert the tagged 
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words and phrases in accordance with the user preferences 
received from the client. 

Figure 6 is a block diagram illustrating a preferred 
embodiment of the present invention, for implementing 
semantic features in a syntactical transcoder. Figure 6 
depicts a prior art relationship between transcoding 
proxy 600, client 620, and web server 610. As described 
above, client 620 makes a request for a URL. Transcoding 
proxy 600 passes the request to web server 610 and 
intercepts the returned request results which were 
intended for client 620. 

Transcoding proxy 600 includes all transcoding 
functions described above with resect to transcoding 
proxy 100 shown in Figure 1, including syntactical 
transcoder 602 for converting individual data formats 
from one format to another, device transcoder 604 for 
converting web formatted data to a format more suitable 
for displaying on certain devices, and protocol 
transcoder 606 for converting data which is typically 
broadcast using a non-HTTP protocol into HTTP protocol. 

In addition to the above-described functionality, 
transcoding proxy 600 now includes semantic features 608 
in addition to the already available syntactic 
transcoding features in syntactic transcoder 602. These 
transcoder features include, but are not limited to: 
readability level conversions for presenting the document 
to readers with various levels of language skills; locale 
conversions, for converting constants that vary from 
locale to locale; content filtering for restricting 
document content from specified readers; governmental 
regulation restrictions for restricted media and content 
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regulated by governmental mandate; and natural language 
translators for translating the document language. 

Depending on the configuration of the proxy server 
in the network, once the request for the document is 
5 received and passed on by transcoding proxy 600, the 

proxy is then provided with the semantic preferences from 
client 620. This process may proceed by various modes, 
such as the client merely sending semantics preferences 
to the transcoding proxy without being queried. This 

10 could be the mode in the case of reverse transcoding 
proxies that receive requests from a number of clients 
for a single origin server. Other cases, forward 
transcoding proxies, for instance, might query the client 
for necessary preferences. In the case of forward 

15 transcoding proxies, certain preferences might remain 
fairly constant, such as natural language, government 
regulations, and locale; while reader level and content 
may change from user to user. In that case, the forward 
transcoding proxy stores some preferences and requests 

20 the remainder of the preferences from the client. 

Standard techniques for content negotiation may be used 
between the transcoding proxy and client (s). 

Returning to Figure 6, transcoding proxy 600 
converts the requested documents to a form compatible 

25 with client 620 by using the semantics preference 

specified by client 620. As can be seen from the above 
description, the document transcoder modifies the 
transcoded output to suit the client. That is, the 
transcoding server not only converts the document from, 

30 say, one syntactic format to another (e.g., PDF to HTML), 
but also simultaneously translates the document into the 
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client-preferred readability level and natural language 
with appropriate content-filtering, locale information, 
and governmental regulations compliance on the 
transmitting and receiving ends. 
5 Figure 7 is a flowchart depicting the process of 

converting document semantics in association with 
converting the document's syntactic format. The process 
begins with a client requesting a specific document. For 
example, say document D is requested from the transcoding 

10 proxy (step 702) . The client provides the semantics 
preferences, including but not limited to: readability 
level preferences of document (e.g., readability level 
RL_1); locale preferences, L_l; content filtering 
instructions preferences, CF_1; governmental regulations 

15 preferences, GR_1; natural language of dociament 
preferences, N_l; and document syntactic format 
preferences, D_l (step 704) . 

The transcoding proxy requests and receives document 
D, from the web server (also known as the origin server) 

20 in the origin readability level of document D, for 

example, RL_2, origin locale, L_2, conformant with origin 
content filtering instructions, CF_2, conformant with 
origin governmental regulations, GR_2, in origin natural 
language of document, N_2, and in origin document 

25 syntactic format (step 706) . 

Optionally, the transcoding proxy makes additional 
queries to the client in order to further identify client 
preferences and capabilities (step 708) . Using the 
client semantics preferences, the transcoding proxy 

30 revises document D (step 710) . The revision can be 

accomplished sequentially or in parallel or as would be 
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understood by an ordinary artisan in the art. By way of 
the example origin document, document D, the transcoding 
proxy converts the origin semantics of document D to the 
semantics of the client. The origin readability level of 
5 document D, RL_2, is converted to the client readability 
preference, RL_1 . The origin locale, L_2, is converted 
to the client locale preference, L_l . The origin content 
filtering, CF_2, is converted to client content 
filtering, CF_1 . The origin governmental regulations, 

10 GR_2, are converted to the client preference, GR_1. The 
document's natural language, N_2, is translated to the 
client's preference natural language, N_l . Finally, the 
origin syntactic format, D_2, is converted to the client 
syntactic preference, D_l. After the conversion, 

15 document D is sent to the client (step 712) . At that 

time, the document semantics are readability level RL_1, 
locale is L_l, conformant with CF_1 content filtering 
instructions, conformant with GR_1 governmental 
regulations, N_l natural language of document, and 

20 document syntactic format of D 1. 

Figure 8 depicts a configuration between transcoding 
proxies 800, 810 and 820, client 840, and web server 850, 
for providing multiple transformations in order to 
provide a wide range of semantics preference options in 

25 formatting a document for a client. Transcoding proxies 
800, 810 and 820 are identical in functionality to 
transcoding proxy 600, including semantics features, and 
therefore, will not be discussed in detail again. 

In the depicted example, client 840 makes a request 

30 for a uniform resource locator (URL) . Transcoding proxy 
800 is then provided by the semantic preferences from 
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client 840. Next, transcoding proxy 800 compares the 
semantics preferences to the semantics features supported 
by transcoding proxy 800 and, if all conversions are 
supported by transcoding proxy 800, the request is sent 
5 to the origin server, web server 850. If not, 
transcoding proxy 800 passes the request to an 
intermediate transcoding proxy, such as transcoding proxy 
810, for intermediate semantics conversions. In that 
case, the requested document is returned from transcoding 

10 proxy 810 partially transcoded, such that transcoding 
proxy 800 can complete the conversions. The fully 
transcoded document is then returned to client 840. 

It is important to note that, while the present 
invention has been described in the context of a fully 

15 functioning data processing system, those of ordinary 
skill in the art will appreciate that the processes of 
the present invention are capable of being distributed in 
the form of a computer readable medium of instructions 
and a variety of forms, and that the present invention 

20 applies equally regardless of the particular type of 
signal bearing media actually used to carry out the 
distribution. Examples of computer readable media 
include recordable-type media such as floppy discs, hard 
disk drives, RAM, and CD-ROMs and transmission-type 

25 media, such as digital and analog communications links. 
The description of the present invention has been 
presented for purposes of illustration and description 
but is not intended to be exhaustive or limited to the 
invention in the form disclosed. Many modifications and 

30 variations will be apparent to those of ordinary skill in 
the art. This embodiment was chosen and described in 
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order to best explain the principles of the invention and 
the practical application, and to enable others of 
ordinary skill in the art to understand the invention for 
various embodiments with various modifications as are 
5 suited to the particular use contemplated. 
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CLAIMS : 

What is claimed is: 

1, A transcoder processing system implemented method 
for converting documents based on semantic 
characteristics, comprising; 

receiving a request for a document from a 
client; 

passing the request to an origin servers- 
receiving the requested document from the 
origin server; 

performing a syntactical transcoding on the 
requested document, wherein at least one semantic 
characteristic of the requested document is 
converted; and 

sending the requested document to the client. 

2, The transcoder processing system implemented method 
recited in claim 1 further comprises receiving at least 
one semantic characteristic preference from the client, 
wherein the at least one semantic characteristic is 
automatically converted based on the at least one 
semantic characteristic preference, 

3, The transcoder processing system implemented method 
recited in claim 2, wherein a semantic characteristic 
preference specified by the client is readability level 
of the requested document. 



29 

Docket No. AT9-99-310 

4. The transcoder processing system implemented method 
recited in claim 3, wherein the at least one semantic 
characteristics is the readability level of the requested 
document . 

5 

5. The transcoder processing system implemented method 
recited in claim 2, wherein a semantic characteristic 
preference specified by the client is locale. 

10 6. The transcoder processing system implemented method 
recited in claim 5, wherein the at least one semantic 
characteristic is the locale characteristic of the 
requested document. 

15 7. The transcoder processing system implemented method 
recited in claim 2, wherein a semantic characteristic 
preference specified by the client is conformance with 
specified governmental regulations by the requested 
document . 

20 

8. The transcoder processing system implemented method 
recited in claim 7, wherein the at least one semantic 
characteristic is the conformance with specified 
governmental regulations of the requested document. 

25 

9. The transcoder processing system implemented method 
recited in claim 2, wherein a semantic characteristic 
preference specified by the client is conformance with 
specified content filtering in the requested document. 

30 

10. The transcoder processing system implemented method 
recited in claim 9, wherein the at least one semantic 
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characteristic is the conformance with specified content 
filtering of the requested document. 

11. The transcoder processing system implemented method 
5 recited in claim 2, wherein a semantic characteristic 

preference specified by the client is the natural 
language of the requested document. 

12. The transcoder processing system implemented method 
10 recited in claim 11, wherein the at least one semantic 

characteristic is the natural language of the requested 
document . 

13. The transcoder processing system implemented method 
15 recited in claim 2 further comprises comparing the at 

least one semantic characteristic preference received 
from the client with semantic conversion features 
supported by the transcoder processing system, 

20 14. The transcoder processing system implemented method 
recited in claim 13, wherein the step of passing the 
request to a server further comprises passing the request 
to a 'transcoding server on the basis of the comparison. 

25 15, A transcoder processing system implemented method 
for converting documents based on semantic 
characteristics, comprising: 

receiving at least one semantic characteristic 
preference from a client; 

syntactically transcoding a document; and 
converting at least one of the semantic 
characteristics of the document, wherein converting 
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10 



is based on the at least one semantic characteristic 
preference . 

16. The transcoder processing system implemented method 
recited in claim 15, wherein the at least one semantic 
characteristic preference is one of readability level, 
locale, content filtering, compliance with governmental 
regulations, and natural language. 

17. The transcoder processing system implemented method 
recited in claim 15, further comprising: 

transcoding the document using one of a 
protocol transcoder and a device transcoder. 

15 18. A transcoder processing system implemented method 
for converting documents based on semantic 
characteristics, comprising: 

requesting a document from an origin server 
from a clients- 
transmitting at least one semantic 
characteristic preference from a client, wherein the 
at least one semantic characteristic preference is 
one of readability level, locale, content filtering, 
compliance with governmental regulations, and 
25 natural language; and 

receiving the document, wherein the document 
has been syntactically transcoded and converted 
using the at least one semantic characteristic 
preference . 



20 



30 



19. A transcoder processing system for converting 
documents based on semantic characteristics, comprising: 
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receiving means for receiving a request for a 
document from a client; 

passing means for passing the request to an 
origin server; 

5 receiving means for receiving the requested 

document from the origin server; 

performing means for performing a syntactical 
transcoding on the requested document, wherein at 
least one semantic characteristic of the requested 
10 document is converted; and 

sending means for sending the converted 
document to the requesting client. 

20. The transcoder processing system recited in claim 19 
15 further comprises receiving means for receiving at least 

one semantic characteristic preference from the client. 

21. The transcoder processing system recited in claim 
19, wherein a semantic characteristic preference 

20 specified by the client is readability level of the 
requested document. 

22. The transcoder processing system recited in claim 
21, wherein the at least one semantic characteristic is 

25 the readability level of the requested document. 

23. The transcoder processing system recited in claim 
19, wherein a semantic characteristic preference 
specified by the client is locale. 

30 
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24. The transcoder processing system recited in claim 
23f wherein the at least one semantic characteristic is 
the locale characteristic of the requested document. 

5 25. The transcoder processing system recited in claim 
19, wherein a semantic characteristic preference 
specified by the client is conformance with specified 
governmental regulations by the requested document. 

10 26, The transcoder processing system recited in claim 

25, wherein the at least one semantic characteristic is 
the conformance with specified governmental regulations 
of the requested document. 

15 27. The transcoder processing system recited in claim 
19, wherein a semantic characteristic preference 
specified by the client is conformance with specified 
content filtering in the requested document. 

20 28. The transcoder processing system recited in claim 

27, wherein the at least one semantic characteristic is 
the conformance with specified content filtering of the 
requested document. 

25 29. The transcoder processing system recited in claim 

28, wherein a semantic characteristic preference 
specified by the client is the natural language of the 
requested document. 

30 30. The transcoder processing system recited in claim 

29, wherein the at least one semantic characteristic is 
the natural language of the requested document. 
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31. The transcoder processing system recited in claim 19 
further comprises comparing means for comparing the at 
least one semantic characteristic preference received 

5 from the client with semantic conversion features 
supported by the transcoder processing system. 

32. The transcoder processing system recited in claim 
31, wherein the passing means for passing the request to 

10 a server further comprises passing means for passing the 
request to a transcoding server on the basis of the 
comparison . 

33. A transcoder processing system for converting 

15 documents based on semantic characteristics, comprising: 
receiving means for receiving at least one 
semantic characteristic preference from a client; 

syntactical means for syntactically transcoding 
a document; and 

20 converting means for converting at least one of 

the semantic characteristics of the document, 
wherein converting is based on the at least one 
semantic characteristic preference. 

25 34. The transcoder processing system recited in claim 
33, wherein the at least one semantic characteristic 
preference is one of readability level, locale, content 
filtering, compliance with governmental regulations, and 
natural language. 

30 

35. The transcoder processing system recited in claim 
33, further comprising; 
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transcoding means for transcoding the document 
using one of a protocol transcoder and a device 
transcoder . 

5 36. A transcoder processing system for converting 

documents based on semantic characteristics, comprising: 
requesting means for requesting a document from 
an origin server from a client; 

transmitting means for transmitting at least 
10 one semantic characteristic preference from a 

client, wherein the at least one semantic 
characteristic preference is one of readability 
level, locale, content filtering, compliance with 
governmental regulations, and natural language; and 
15 receiving means for receiving the document, 

wherein the document has been syntactically 
transcoded and converted using the at least one 
semantic characteristic preference. 

20 37. A transcoder processing computer program product for 
converting documents based on semantic characteristics, 
comprising: 

receiving instructions for receiving a request 
for a document from a client; 
25 passing instructions for passing the request to 

an origin server; 

receiving instructions for receiving the 
requested document from the origin server; 

performing instructions for performing a 
30 syntactical transcoding on the requested document, 

wherein at least one semantic characteristic of the 
requested document is converted; and 
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sending instructions for sending the converted 
document to the requesting client, 

38. A transcoder processing computer program product for 
5 converting documents based on semantic characteristics, 
comprising: 

requesting instructions for requesting a 
document from an origin server from a clients- 
transmitting instructions for transmitting at 
0 least one semantic characteristic preference from a 

client, wherein the at least one semantic 
characteristic preference is one of readability 
level, locale, content filtering, compliance with 
governmental regulations, and natural language; and 
5 receiving instructions for receiving the 

document, wherein the document has been 
syntactically transcoded and converted using the at 
least one semantic characteristic preferences. 



37 

Docket No. AT9-99-310 



ABSTRACT OF THE DISCLOSURE 



SYSTEM AND METHOD FOR INCORPORATING SEMANTIC 
5 CHARACTERISTICS INTO THE FORMAT-DRIVEN SYNTACTIC DOCUMENT 

TRANSCODING FRAMEWORK 



Initially, a client requests a specific document and 

10 provides the preferences, including readability level 

preferences of the document, locale preferences, content 
filtering instructions preferences, governmental 
regulations preferences, natural language preferences, 
and document syntactic format preferences. The 

15 transcoding proxy requests and receives the document from 
the origin server, with the document having origin 
semantic characteristics. The document from the origin 
server has an origin readability level and origin locale, 
is conformant with origin content filtering instructions 

20 and origin governmental regulations, and is in origin 

natural language and in origin document syntactic format. 
Using the client semantics preferences, the transcoding 
proxy revises the document in a sequential or parallel 
fashion. The origin semantics characteristics of the 

25 document are, thus, revised to the semantic preferences 
specified by the client. 
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